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(54) Title: SPORTS TECHNIQUE VIDEO TRAINING DEVICE 



(57) Abstract 

A video training device (12) for enabling a stu- 
dent athlete (10) to closely pattern his dynamic tech- 
nique after that of a recognized master. The device in- 
cludes a pair of video cameras (14A, 14B) that trans- 
mit live images (lOA) of the student as seen from 
those directions (e.g., 20, 21) that best represent the 
technique. A video overlay generator (24) receives the 
live images ^aiuij:Qinbine s them with^a correspondip g 
set of self-generated temglate.imfi.e.sj(4^ 
^enTlhe dvnamic"technique of the master. The com - 
Finea^ts of ima ges are sent. to^paiLjoIidsuaLmoni- 
torr(T8 ATI'S ByTorsimultan eous^suRe^ 
pla v of each set on a respective screen (38 A, 38B). ^ 
User-operated controls on the video overlay generator 
(24) permit the static image (48) on each screen to be 
adjusted in size, moved vertically or horizontally, or 
switched to a new static image representing a differ- 
ent sport situation. 
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SPORTS TECHNIQUE VIDEO TRAINING DEVICE 

TECHNICAL FIELD 
The following invention relates to a training 
5 device for athletes and more particularly, to a video 

system which may be used by student athletes engaged in a 
sports activity in order to match their dynamic technique 
with that of a recognized master in the f ield« 

10 BACKGROUND ART 

There are a number of visual systems that 
provide overlays by superimposing two dynamic video 
representations of the same activity. Such systems are 
shown, for example, in Michaels et al. U,S. Patent 
15 No. 4,015,344, Haas et al . U.S. Patent No. 4,137,566, 
McCullough et al. IJvS. Patent No. 3,408,750 and Seidel 
et al. U.S. Patent Np. 4,828,500. 

All of these references make use of a directly 
recorded image of the master, such as on video tape, 
20 taken while the master is performing a particular dynamic 
technique and provide the student with a means of over- 
laying an image of his own technique against that of th 
master in order to determine what deviations exist. 
These systems, however, are difficult to use and to cali- 
25 brate. Because of the different sizes and positions of 

the images, it is hard to exactly overlay the two images. 
Further, the two images are time based. That is, because 
they are dynamic representations of the sports activity, 
in order to be useful to the student the movements must 
3 0 take place at the same relative time. This is especially 
true in a context in which the positions of the body and 
its extremities, or equipment such as a bat, tennis 
racket, or golf club, are to be compared at different 
points of the stroke. 
35 In many athletic endeavors, however, the rate 

of speed at which an activity is performed is not as 
important as the position of the hands, arms, r feet at 
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different times during the movement. For example, a golf 
swing is highly dependent upon maintaining certain 
desired positions of the hands, the arms, the head, and 
the position of the club at various points during the 
5 swing. Moreover, these time-based systems, are difficult 
for a student to use interactively, that is, as he or she 
is actually performing the technique. During practice of 
a golf swing, for example, as the student is observing 
the moving image of the master on the overlaid display, 

10 the student would not only have to match the various arm, 
head, and club head positions of the master, but would 
also have to swing the club with the same degree of force 
(which is time dependent) in order to affect a valid 
comparison at all points during the swing. 

15 An alternative type of system is shown in Mann, 

U.S. Patent No. 4,891,748. In this system, a computer- 
generated image is made representing the cumulative tech- 
nique of several masters. This image is scaled, by the 
computer, to the size of the student's image and is 

20 advanced, frame-by- frame, on the overlay display, so that 
the student can imitate the static pose recorded in each 
frame. Unless there is someone available who is willing 
to assist with this system, however, the student must 
either select each frame, forcing the student to repeat- 

25 edly break his own stance while selecting the individual 
frames representing a particular movement, or rely on 
automatic frcune advancement, forcing the student to keep 
pace with the preselected rate at which the frames are 
advanced. Moreover, the elaborate software needed to 

30 operate this system is expensive to develop and must be 
customized for each individual student. 

Less complex systems are known that use a 
mirror to perform an overlay function, such as those 
shown in Light U.S. Patent No. 3,611,591 and Casey U.S. 

35 Patent. No. 3,915,457. In Casey, for example, a trans- 
parent sheet bearing an image of the master in a number 
of different poses is set dir ctly over a convex mirror. 
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thereby forming an overlay together with the image of the 
student reflected in the mirror • Only a relatively 
limited number of poses can be represented with clarity 
on any one sheet, however, forcing the student to repeat- 
5 edly interrupt practice to replace transparencies* More- 
over, with such systems, the student can only observe his 
technique from a single direction opposite the normal 
line of sight for that technique. During a normal golf 
swing, for example, the student will be looking in a 

10 forward direction down toward the golf ball and will not 
be able to assess his technique as it appears in a mirror 
that is placed off to one side or above his head. Nor 
do these systems permit assessment of technique from 
multiple views at once. 

15 Accordingly, what is needed, then, is an 

inexpensive interadtive training system that enables a 
student to compare h^is dynamic technique in a sport with 
that of a master's from whatever view and with whatever 
pace is most effective in that sport for that particular 

20 student. 

DISCLOSURE OF THE INVENTION 
To achieve these ends, the present invention 
includes a video camera for transmitting a live image of 

25 the dynamic technique of the student in a selected sports 
situation as viewed from the most representative direc- 
tion and a visual monitor for displaying the live image 
to the student. A video overlay generator is provided 
for producing a static image representing the dynamic 

3 0 technique of the master in the same sport situation and 
as viewed from the same direction, and includes an over- 
lay mechanism for combining the live image and the static 
image for simultaneous superimposed display on the visual 
monitor. 

35 The static representation of the dynamic 

technique of the master could include a series of 
outlines where each outline delineates the path of travel 
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of a respective extremity of the master during execution 
of the technique. For example, a continuous or dashed 
outline could be used to represent the path of travel of 
the master's hands during the swing. A different out- 
5 line, moreover, could be used to represent the path of 
travel of the golf club head during the backswing and a 
further outline could be used to represent positions of 
the golf club head on the dovmswing. 

In order for the athlete to be able to monitor 

10 his own technique as it is being executed, the visual 

monitors are placed within the athlete's line of sight. 
The monitors may provide a split-screen so that the live 
image of the athlete, as viewed from two or more differ- 
ent directions, can be observed simultaneously in super- 

15 imposed overlay vxt\ the master's image. Where the 

athlete's line of sight is limited, such as when looking 
down on a golf ball, a mirror can be used to enable view- 
ing of both screens. When a mirror is used, the visual 
overlay could be accomplished either with a video tem- 

20 plate generated as explained below or with a permanent 

template comprising a translucent drawing secured to the 
screen of one or both monitors. Use of a mirror is also 
beneficial because it converts the direct image displayed 
on the monitors, which includes a view of the student 

25 from the perspective in which others see the student, 
into a reverse image, which includes a view of the 
student from the perspective in which the student 
normally sees himself or herself. 

A video overlay generator may be provided which 

30 generates a plurality of video images or "templates" for 
selective combination, as by conventional television 
mixing equipment, with the live image of the athlete as 
transmitted by the video camera. Each template is a 
static image representing the dynamic technique of the 

35 master in a different sport situation, such as during a 
golf swing with a certain type of club. The video 
overlay generator may provide controls operable by th 
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athlete for calibrating images so that the position and 
spatial dimensions of the template are matched with that 
of the athlete's on-screen image to create a closely 
superimposed overlay. The memory in the video overlay 
5 generator may include a menu image to provide an on- 
screen list of a plurality of different templates, corre- 
sponding to different sports situations, and from which 
the athlete may select a particular template of interest. 
A second aspect of the present invention 

10 includes a training method. In this method, a live image 
of the dynamic technique of the student is transmitted 
using a video camera and is combined with a static image 
of the dynamic technique of the master for simultaneous 
superimposed display on a visual monitor. The camera can 

15 be positioned for whatever view will best show the tech- 
nique. The static image provided includes an outline 
wherein different portions of the outline delineate the 
path of travel of a selected extremity of the master. 
Where the selected sports situation is a golf swing that 

20 includes a transition between a backswing and a down- 
swing, and the student has a "dominant" arm leading the 
downswing, preferably the method includes maneuvering the 
dominant arm of the student in increasing pronation as 
said transition is approached by using the outline as a 

25 guide or "template." 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a perspective view of an exemplary 
sports training device in accordance with the present 
30 invention in use by a student golfer. 

FIG. 2 is an elevational view of a split-screen 
display of superimposed video images, in accordance with 
the present invention, as selectively displayed on the 
monitors and as viewed in the mirror of the exemplary 
35 device of FIG. 1 along lines 2-2. 

FIG. 3 is an elevational view of a main menu 
display, in accordance with the present invention, as 
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selectively displayed on the monitors of the exemplary 
device of FIG. 1. 

FIG. 4 is an enlarged view of the display 
locations indicated by reference numeral 42P in FIG. 2 
5 showing the help message provided therein. 

FIG. 5 is a block diagram showing the internal 
architecture of the video overlay generator box of 
FIG. 1. 

FIG. 6 is a flow diagram showing, in secjuence, 
10 the operations performed by the CPU device of FIG. 5. 

FIG. 7 is a block diagram showing the internal 
architecture of the VOG control device of FIG. 5. 

FIG. 8 is a block diagram showing, in sequence, 
the operations performed by the image displaying group of 
15 devices of FIG. 5. \ 

\ 

* \' 

BEST MODE FOR CARRYING OUT THE INVENTION 
FIG. 1 shows a student golfer 10 using an 
exemplary sports training device 12 configured in accor- 

20 dance with the present invention. The exemplary sports 
training device 12 includes a pair of video cameras 14A 
and 14B^ a pair of video monitors 18A and 183, a mirror 
22 and a video overlay generator 24 having a side panel 
2 6 including a matrix-type array of oversized pressbutton 

25 switches (not visible) . 

In FIG. 1, certain of the elements of. the 
training device 12 are shown, for ease of reference, in 
positions that are somewhat offset from their normal 
positions in an actual training setup. In particula r, 

3 0 the mirror 22 is normally located more forwardly th an 
shown, in a position adjacent the ball 28, so that th e 
golfer 10 can view the pair of video monitors 18 A and 18 B 
through t he mirror while simultaneously keeping his li ne 
"of sight 19 cen tered on the bal l. The video overla y 

35 ^g^jxB^xiLuv 24 i^ normally positioned sufficiently near the 
golfer 10 so that the golfer can selectively operate the 
oversized pressbutton switches with the head end 30 of 
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the club 32 while maintaining the golfer's preferred 
stance for beginning the golf swing. 

The pair of video cameras 14A and 14B are 
suitably arranged to capture the live image of the 
5 student as viewed, respectively, from a front-facing 

direction 20 and side-facing direction 21. The front and 
side images that result have been found effective for 
displaying golf swing technique. If desired, however, 
another camera may be included for obtaining a top view 

10 and a wholly different arrangement of cameras may be 
preferable for an activity different than golf. Each 
camera desirably includes a zoom lens 34, a tape holding 
chamber 36, a slow-motion replay and record feature, and 
an I/O port (not shown) for transmitting images and 

15 receiving control signals. The cameras 14A and 14B that 
are shown in FIG. l\are of the popular 8 mm camcorder- 
type . 

Each visual monitor 18A or 18B includes a 
display screen, 38A and 38B, respectively, and a video 

20 input port (not shown) . The visual monitors are stacked 
together, one atop the other, to provide a split-screen 
for simultaneous display of the front and side images, 
respectively. The distance of the mirror 22 to the 
visual monitors 18A and 18B is adjusted so as to vary the 

25 size of the reflected image of the visual monitors until 
the full image of the visual monitors can be seen by the 
golfer while looking down toward the ball. 

The exemplary vide o overlay generator 24, 
herea fter referred to as "VOG ," processes __the—l.iv.e-,images 

3 0 ( fro nt and side) of the student before they are dis played 
on the visual monitors 18 A and 18 B, that is, while th e 
live i mages are still in video ^sianal^f ormat. In par- 
ti cul a r^_the_VOG^ 

37A and j7B and combines them with corr esp.ondin g stati c 
3 5 im ages or "te mplatesJ!L^48— f-F4EG-^— 2-)— that^represent^ 

out 1 in e form, the dynamic te_c hnicrue_pf the mast er in a 
particular game situation. These static images are 
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selectively generated by the VOG from a collection of 
similar- type images which are stored in the VOG as coded 
data . Referring to FIGS. 1 and 2 toc retlue xL .- a fj t er ^com bin- 
ation , the live images lOA (front„a n d_side. ) _and_the ir 
5 correspo nding static images 48 are_,t ransm±.tted— to=the 
visual mo nitors 18 A and 18 B, via a vi deo-cabl-e-4'€H7==-fQr 
s imul taneous^superijiEP^ 

3 8A and 3_aB ... 

The term "superimposed display" as used herein 
10 and in the claims has a specialized meaning that will now 
be explained. If each display screen, 38A or 38B, is 
divided, by row and column, into a number of small but 
discrete display locations (e,g., 42A-N) , the correspond- 
ing static image of the master's technique 48 is deemed 
15 to be superimpos ed over the live im a ge of the student l OA 
when both ^ypes of image commonly occup y at least certain 
ones of ^g 3Jich-.dA-sp'l"ay— loca-trions— (-e-rg— — 4-2 B and 421) • 

In F IG. 2, two t\ mes,-oJ--stat4c— images-,4,8,,ar^e^ 
shown^ fpr-^represexifcing^fchg— techniq ue, of the master. The 

2 0 first type of statocimage^ji 

ary component of the technique, uses a dashed reference 
Tine or curve to delineate the placement of a r epresen ta- 
tive extremity of the masti^^^t jbhe ,sjt arjb^ox^f.inls,h__Qf 
the technique. For example, lines 52, 5A , 56, and 58 
25 delineate the initial place ment ^ f the m^^ 

toi^oT^^urve^^ 62 , 64, jind 6 6 del ineate^ the initial 
and^ final placement of the master's head; and lines 68 
ajid'To^eTineat^ f'^^Sie^l ub'^™^ 

gripped by thle ^asl^e F^l €Ke^ this _ i ^tanceV^b^^ 

3 0 a* honimnediate extremi ty ) The second type of static 

--image , used to represent a dynamic component of the tech- 
nique^ uses a Connected outline to delineate successive 
posiTxons"""of'X'"re ot^ the m aster at 

a mmber of dif ferent^times ^during executi^Sn^of''^^ 
35 nique. . For xample, dashed^^utljyri^ 
success^^e E^p^sitions_of_t^ 

and HaghiaH nuti ines _7,8_and,8.0_del ineate successive 
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pos itions of the o lAib--faead--a.s--inQxg^d^K^ inj^gter, 
Although^ in FIG. 2 outlines 74-80 are shown in dashed 
form, this has be n done for ease of illustration, and 
such outlines may also be made continuous, the important 
5 principle being that more than one position is repre- 
sented by each outline. As shown, directional arrows 82 
and 84 are used to identify the backswing and downswing 
components, respectively, of each technique. 

T he use of the described static image 48 t o 
10 represent the dynamic technique of the master and the 

on-screen super imposition of this static image with the 
live image l OA of the student, enables the student 10 to 
closely pattern his dynamic technicme after that of the 
master. For example, with reference to the images shown 
15 on the top screen 38A in FIG. 2, the student practicing 
his upswing will attempt to guide his hands so that the 
on-screen image of hi^ hands 31A moves along the path of 
the respective display locations (e.g., 42B-D) that are 
occupied by different portions of the hand outline 74. 
20 Concurrently, the student attempts to guide the club so 

that the on-screen image of the clxib head 3 OA moves along 
the path of the respective display locations (e.g., 
42E-F) occupied by different portions of the club head 
outline 80. 

25 The student, moreover, attempts the same 

"tracing" action in regard to the lower screen 38B so 
that, for example, the on-screen image lOA moves across 
display locations 42C, 42E, 42J, and 42L, or across 
display locations 42D, 42P, 42K, and 42M, in unison. 

30 Referring to FIGS. 1 and 2 together, the mirror 22, by 

reversing the images shown on the visual monitors 18A and 
18 B, makes this , -acing action easier because a movement 
of the student's ..eft arm 33 in a rightward direction 86 
appears, in the mirror, as a corresponding movement of a 

35 left arm 33A in a rightward direction 86A. 

From the above description of the pr ferred 
training method, it will be recognized that pr cision of 
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movement, and not pace, is the primary focus of the 
method • What matters is that each portion of the live 
image be moved, in correspondence with the others, to its 
prescribed location, not how long it takes to reach those 
5 locations. Once the student's muscles have been trained 
to properly execute the master's technique in slow 
motion, the pace of the technique can readily be 
increased. Conventional methods that attempt to teach 
both precision of movement and pace (e.g., by using a 

10 dynamic image of the master's technique) present the 
student with the impossible task of tracing through 
multiple points where each point is itself a moving 
image. The end result of such methods is that the 
student merely attempts to imitate the broad lines of 

15 movement of the master. 

To understand more fully the benefits of the 
described training system, it is helpful to consider the 
basic movements involved during execution of a particular 
technique. In all, three fundamental hand and arm move - 

20 ments have been identified that contribute to the overall 
movement typically developed during a golf swing. The 
first of these is the lateral wrist cock obtained, for 
example, by placing the palm of the hand on a flat table 
and cocking the wrist from side-to-side. It is generally 

25 accepted that proper swing technique requires cocking of 
the wrist during the upswing and holding of this condi- 
tion during most of the downswing until final release of 
the cocked wrist just before impact of the club with the 
ball. The second type of basic movement, one preferably 

30 avoided, is the forward or backward wrist swing obtained 
by swinging the hand in a direction generally 
perpendicular to the palm. 

The third type of basic movement is a forward 
or backward rotating movement of the forearm and hand, in 

35 unison e about the long axis of the forearm. When this » 
mov ment tends to bring the palm face up, this can be 
termed "supination" (to suggest the supine position of 



BNSOOCID- <WO onnooTOAi 1 > 



wo 93/00970 



PCr/US92/05274 



the hand obtained) or, conversely, when this movement 
tends to bring the palm face down or rearward, this can 
be termed "pronation" (to suggest the prone position of 
the hand) . It is generally accepted that before impact 
5 of the clxib with the ball, some degree of supination of 
the dominant arm (e.g., the left arm for a right-handed 
golfer) should occur so that the club head squarely 
impacts the ball. 

Referring now to FIG. 2, it has been 
10 discovered, in developing the exemplary training device 
12, that it is typical for a master golfer^ when nearing 
the top of his or her upswing, to increasingly pronate 
his or her dominant arm, by rotating it in the direction 
88 shown, and then to maintain this pronation during the 
15 downswing until just before impact of the clxib head with 
the ball. It has also been found that a typical student, 
conversely., will supXnate his or her arm when reaching 
the top of the upswing. Accordingly, even though the 
student properly moves the hands in suitably cocked posi- 
20 tion along the hand outline 74, to the upswing position 
delineated at display locations 42D and 42K, unless his 
or her arm is properly pronated, the club head image 3 OA 
will end up at display locations 42G and 42N. Not until 
the student rotates his arm in the correct direction 88 
25 will the club head image shift to its desired display 
locations 42F and 42M. It will now be recognized just 
how use of multiple outlines forces the student to adopt 
the same basic movements as the master and develops, in 
the student, a more efficient and powerful swing. 
30 Referring to FIG. 3, for ease and flexibility 

in selection, when the VOG 24 and visual monitors 18 A and 
18B are first turned on, appearing on the screen of the 
monitors, in place of the static images 48 of the 
master's technique shown in FIG. 2, is a main menu 96. 
35 The menu 96 has a listing of ten alternative golfing 
situations 98 (e.g., in one type of situation the "3 
Wood" technique is used) and includes a cursor 100 that 
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can be moved on the screen to select the pair of tem- 
plates (front and side views) that correspond to the 
desired golfing situation. At the bottom of the screen 
are instructions 102 that identify respective ones of the 
5 switches on the side panel 2 6 (FIG. 1) of the VOG 24 and 
explain how such controls are operated to move the cursor 
and to make a selection * Accordingly, the student golfer 
can use the head 30 of the club 32 to select a desired 
type of situation while maintaining his or her starting 
10 stance proximate the ball 28. The selections and on- 
screen instructions appear in both "Normal Text" (for 
direct viewing) and "Reversed Text" (for viewing through 
the mirror 22) . 

FIG. 2 shows the specific images 48 of the 
15 master's technique appearing on the upper and lower 

screens 3 8A and 38B after the "5 Iron" golfing situation 
is selected on the menu of FIG. 3. Certain of the 
display locations 42P on each screen are reserved for the 
display of a help message 104. This help message, shown 
20 in FIG. 4, has instructions 106, 108, and 110 pertaining, 
respectively, to on-screen calibration commands, 
teaching-mode commands, and a return to main menu 
command. As with the main menu 96, each instruction on 
the help message 104 appears in both normal text and 
25 reverse text. 

The calibration commands 106 are used for 
aligning, on each screen 38A or 38B, the static image 48 
of the master's technique with the live image lOA of the 
student. In particular, the student first uses the pan 
30 up or down and pan left or right controls to align the 

ball portion of the static image 48 with the ball portion 
28A of the live image. Next, the student uses the zoom 
out or in controls to vary the size of the static image 
48 until it matches the size of the live image lOA. 
3 5 The teaching -mode commands 108 enable the 

student to view, separately, the starting pose and the 
various components of the dynamic technique of the 
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master* For example, after selecting the static images 
48 shown in FIG. 2, the student may then decide to view 
only the "setup" or starting pose component of the 
technique (lines 52-70) by pressing down one time on the 
5 SELECT control. This causes the outlines 74-80 that 
represent dynamic technique to be hidden from view. 
Next, the student may decide to view only the backswing 
component of the technique by pressing down a second time 
on the SELECT control. This causes each of the "setup" 
10 lines 52-70 and the portions of outlines 74-80 that are 

marked by downswing arrows 84 to be hidden from view. By 
pressing a third time on the SELECT control, the student 
can separately view the downswing component of the 
technique, and by pressing a fourth time on the SELECT 
15 control, the studeut can return to the initial view shown 
in FIG. 2 wherein the starting pose and each component 
of the dynamic technique are displayed simultaneously 
together. In this simultaneous view, for clarity of 
display, each component is preferably shaded in a 
20 different color so that, for example, the starting pose 

lines 52-70 are green, the backswing portions of outlines 
74-80 are red, and the downswing portions of outlines 
74-80 are blue. 

After completing a training session, the 
25 student can return to the main menu 96 (FIG. 3) using the 
main menu command 110 (FIG. 4) and select a new golfing 
situation using the same steps that have already been 
described. Alternatively, provided that the tape holding 
chamber 36 of each camera 14A or 14B has previously been 
3 0 loaded with tape and the live training session recorded, 
the student can choose to continue displaying the static 
image 48, as shown in FIG. 2, while playing back the 
recorded session. In this manner, the student may eval- 
uate his or her technique post-session, either alone or 
35 in the company of an instructor, to d termine how closely 
his or her technique matched the technique of th master 
and to decide what changes in movem nt are needed to 
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bring about closer conformance therewith. In particular, 
after sufficient practice of the technique at slow speed 
using the template images for immediate feedback, the 
student may find it helpful to perform the same movement 
5 at normal or "full" speed while recording the movement 

using a fast shutter setting on the video cameras. Then, 
using the slow-motion replay feature of one or the other 
camera, the student can compare his full-speed technique 
with that of the master. 

10 The construction and operation of the exemplary 

video overlay generator 24 will now be explained with 
reference to FIGS. 5-8. In FIG. 5, a block diagram is 
shown identifying the electronic components constituting 
the video overlay generator. As shown, the VOG 24 

15 includes a first and^ second board 116 and 118 that sepa- 
rately process the f^pnt and side images, respectively, 
of the student. Thes e live images ar e^^ec e i y : ed y .j^ 
cadDles 38A and 38B (FIG. 1 ) at the input ports 119 and 

120 Of the VOG 24. At the completion of processing, the 

2 0 boards 116 and 118 produce, at their respective outputs 

121 and 122, either a combined signal conveying the live 
image and template image together, thereby producing an 
on-screen display of the type shown in FIG. 2, or a 
signal conveying the menu image, thereby producing an 

25 on-screen display of the type shown in FIG. 3 (for each 
visual monitor) . Both types of signal output are com- 
patible with existing standards for composite television 
signals. 

Referring to FIGS. 1 and 5 together, in order 

3 0 for the user to interface with the VOG, the pressbuttons 

on the front panel 26 of the VOG are formed into a 
matrix-type arrangement of input switches 123, each 
pressbutton switch (e.g., 124) being of the single-pole 
single-throw (SPST) type and connecting a particular ROW 
35 line to a particular COLUMN line when closed. The ROW 
and COLUMN lines are connected to the ROW and COLUMN 
input bus 125 and 126, respectively, of both the first 
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board 116 and the second board 118. Although not 
explicitly shown, the internal devices of the second 
board 118 are the same as those of the first board 116. 

Generally speaking, there are two principal 
5 groups of devices on each board 116 or 118. The first 
group, constituting the "image creating" devices, inter- 
act with the dynamic random access memory or DRAM 128 
during even-numbered memory cycles (e.g., cycles 0, 2, 4, 
.••). The purpose of this first group is to decide what 

10 image will be created (e.g., a menu image, a template 

image, or an update image) and to transfer the selected 
image to the DRAM 128 for storage of the image as an 
addressable bitmap array. The devices primarily included 
in this first group are a central processing unit or 

15 "CPU" 130, an erasable programmable read-only memory or 
"EPROM" 132, and a switch encoder and latch unit 134. A 
flow diagram outlining the sequence of operations that 
are performed by this first group of devices is shown in 
FIG. 6. 

20 The second group of devices, constituting the 

"image displaying" devices, interact with the DRAM 128 
during odd-numbered memory cycles (e.g., cycles 1, 3, 5, 
. . . ) . The purpose of the second group is to retrieve 
portions of the most recent image stored in the DRAM, to 

25 sequentially translate each portion or bitmapped word in 
this image into picture information, and to generate a 
composite video signal output where either picture infor- 
mation isolated from the live image or picture informa- 
tion developed from the DRAM-stored data is selected to 

30 define the pixel value at a given location on the viewing 
screen. The devices included in this second group are a 
video switch 13 6 and several devices that are part of a 
VOG control unit 138. Referring to FIG. 7, showing the 
various devices forming the VOG control unit 138, the 

35 d vices b longing to this second group include a video 

address counter 140, a pixel data shifter 142, a digital- 
to-analog converter or DAC 144, and an NTSC encoder 146. 
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A flow diagram outlining the sequence of operations that 
are performed by this second group of devices is shown in 
FIG. 8. 

The VOG includes a third sxibsidiary group of 
5 devices that synchronize the operation of the first and 
second group with each other and with the live video 
image received from the cameras 14 A and 14 B (FIG. 1) . 
Referring to FIGS. 5 and 7 together, this group includes 
a phase lock loop synchronizer or SYNC PLL 148 connected 
10 in tandem with a clock and subcarrier generator 150. 
These devices generate a pair of quadraphase-shifted 
carrier signals/ I^ and Q^, that are mixed, respectively, 
with the I and Q signals developed in the NTSC encoder 
14 6, and, more importantly, produce the clock signals 
15 (e.g., 152) that coi^rol the overall rate at which the 
VOG devices operate . \ 

This third ^roup also includes the address 
multiplexer 154 and the memory cycle switching unit or 
"MCSU" 156 which enable the CPU 130 and the video address 
20 counter 140 to time-share the address lines "MA" of the 
DRAM 128. For example, on even-numbered memory cycles, 
the MCSU 156 toggles the multiplexer 154 so that the 
address lines "CA" of the CPU 13 0 are connected to the 
address lines of the DRAM 128, while on odd-numbered 
25 memory cycles, the MCSU toggles the multiplexer so that 
the address lines of the video address counter 140 are 
connected to the DRAM 's address lines. Moreover, the 
MCSU 156 enaUDles addressing of the DRAM even though there 
are only nine lines in the address bus "MA" and even 
30 though an 18-bit address is needed to fully specify a 
unique memory location of the 256K (512 row by 512 
column) DRAM. The MCSU performs this task by alternately 
sending to the DRAM, on the memory control bus "MC," 
either a "row address" strobe, signifying that a valid 
35 row address (the upper nine bits of the full address) are 
latched onto the "MA" bus, or a "column" address strobe, 
signifying that a valid column addr ss (the lower nine 
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bits of the full address) are latched onto the "MA" bus. 
These row and column addresses may originate with either 
the CPU 130 or the video address counter 140. 

Referring to FIGS. 5 and 7 together, to 
5 construct the exemplary VOG 24, the following 
commercially available devices were chosen: 

for the CPU 130, Model HZ84COO-10 made by 
Toshiba America of Irvine, California; 

i for the 256 X 4 DRAM 128, Model MT4C4256 made 

10 by Micron of Pocatello, Idaho; 

for the 128K x 8 EPROM 132, Model 27C010 made 
by Intel of Santa Clara, California; 

for the NTSC encoder 146, the phase lock loop 
synchronizer 148, and the clock and subcarrier generator 
15 150, Model MC1378 made by Motorola of Phoenix, Arizona; 

for the m^ory cycle switching unit 156, CMOS 
logic gateg made by Toshiba America of Irvine, 
California; and 

for the DAC 144, Model BT478 made by Brooktree 
20 of San Diego, California. 

It will be recognized from the foregoing and following 
description of VOG operation, that there are many other 
specific models of devices that would perform success- 
fully in this application and that the preceding list is 
25 intended to be illustrative rather than limiting. More- 
over, the functions described herein could be implemented 
using customized integrated circuit technology. 

To assemble the image that will be transferred 
to the DRAM 128, the CPU 130 performs the sequence of 
30 operations that are outlined in FIG. 6. The program 

listing that instructs the CPU 130 when to perform the 
operations is stored in the EPROM 132. Also stored in 
the EPROM, in coded format, is a menu image listing, a 
blank image listing, and 40 different template image 
35 listings. These 40 template image listings fully define 
the four typ s of t aching mode images that are available 
f r ach of th ten types of golfing situations. For 
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example, template listings 1-4 define, respectively, the 
full image, the set-up image, the backswing image, and 
the downswing image for the 9-Iron situation, while 
template listing 37 defines the full image for the putt 
5 situation* 

The menu listing can be generated using a 
standard word-processing program. Each template listing 
is preferably generated by scanning a recorded image of 
the master's dynamic technique, in a selected golf sit- 

10 uation, and editing the image using a program, such as 
ADOBE ILLUSTRATOR^", that can be used to trace outlines 
of selected objects in the image and that will store the 
outlines in a memory-conserving format such as encapsu- 
lated postscript (EPS) . In this particular coded format 

15 a line, for exampleV is vector ially described by its two 
end-points, in contrast to a bitmapped format where every 
point on the line is individually mapped out. The image 
listings, both menu and template, are compiled, linked, 
and loaded into the EPROM. Before relaying image data to 

20 the DRAM, the CPU 13 0 converts the data from the coded 

format in which it is stored (i.e., ASCII format for the 
menu image and EPS format for the template image) into a 
bitmapped format. In this manner, the active display 
area of the DRAM 128 (organized as 512 x 460 memory 

25 locations) corresponds to a viewing screen and each 

four-level bit or data word in a given memory location 
corresponds to a pixel value in a given location on the 

viewing screen. 

Referring to FIG. 5, the CPU 130 is 

30 interconnected with other devices in the first group by 
conventional type address (CA or MA) , data (CD or MD) , 
and control (CC and MC) busses. When reading image data 
from the EPROM, for example, the CPU latches a word on 
the address bus specifying a memory location in the 

35 EPROM, transmits a strobe signal on the control line 

signifying th stability and validity of that word, and 
receives the image data then sent out by the EPROM on the 
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data bus. The same three typ s of signals are similarly 
involved in write operations. Referring to FIG. 7, as 
described above, the CPU time-shares the addr ss lines 
"MA" of the DRAM with the video address counter 140. 
5 Moreover, the 4 -bit data bus "MD" of the DRAM is fed to a 
4- to 8-bit bus register 157 for conversion to a an 8-bit 
bus before connection with the data lines CD of the CPU 
130. Control signals are passed back and forth between 
the CPU 13 0 and the MCSU 156 to let each device know when 
10 valid data has been latched onto bus MD. 

Referring now to FIG. 6, when the VOG 24 is 
first turned on, the CPU begins operation by retrieving 
the menu image code stored in the EPROM, block 160, and, 
after converting the code to bitmapped format, writes or 
15 "renders" the menu image data, during even-numbered 

memory cycles, to th^e DRAM 128, block 162. Operation of 
the second group of circuits, during odd-numbered memory 
cycles, ultimately causes the menu image data in the DRAM 
to be displayed on the screen, block 164, in the form 
20 shown in FIG. 3. 

Next, the CPU polls the switch encoder and 
latch 134 to determine if the cursor switch or key has 
been pressed by the user, block 146. If switch 124 in 
FIG. 5 is the cursor switch, for example, closing the 
25 switch connects a respective one of the ROW lines 158 A 
with a respective one of the COLUMN lines 158B. The 
switch encoder and latch 134, detecting that these lines 
have been connected, generates a coded word identifying 
switch 124. When the CPU 130 calls on or "polls" the 
30 switch encoder and latch 134, this word is latched onto 
the data lines "CD" enabling the CPU to determine that 
the cursor key has been selected. The CPU, upon recog- 
nizing this event, sends data to the DRAM that updates 
the menu image, block 168, so that, for example, the 
35 cursor 100 of the menu display shown in FIG. 3 will shift 
down two lines to indicate the n xt golfing situation. 
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If the cursor key has not been pressed, the CPU 
next determines if the SELECT key has been pressed, block 
170. If not, redisplay of the menu image formerly stored 
in the DRAM occurs, block 164, and the operations repeat 
5 as shown. If the SELECT key has been pressed, the code 
for a selected one of the full image template listings is 
retrieved from the EPROM, block 172, based on the number 
of times the cursor key has been pressed. After the CPU 
converts the template image code into bitmapped format, 

10 the template image is then written to or rendered in the 
DRAM, block 174. There it is operated on by the second 
group of devices to produce a display, block 176, similar 
to that shown on the viewing screen 38A or 38B in FIG. 2. 
The operation of the second group of circuits is the same 

15 whether a menu image, block 164, or template image, block 
176, is stored in the DRAM, and is outlined, in detail, 
in the flow diagram of FIG. 8. 

After rendering the template image in the DRAM, 
the CPU next determines if one of the calibration keys 

20 (e.g., pan up, pan down, pan left, pan right, zoom in, or 
zoom out) has been selected by the user, block 178. If 
so, the CPU retrieves the template image data from the 
EPROM, block 180, and transforms the vectorially- 
described data, in a standard manner by computing its 

25 product with a translation or scaling matrix, block 182. 
Memory space in the DRAM not reserved for active display 
is utilized in this computation. Thereafter, the CPU 
sends the transformed data to the DRAM to update the 
template image, block 184, and the updated template image 

30 is then displayed, block 176. Selection of the "Zoom In" 
switch, for example, causes multiplication of the ROM 
template data by a scaling matrix, ultimately resulting 
in a reduction in the dimensions of the template image 48 
(FIG. 2) displayed on the screen. Optionally, a "Rotate" 

35 switch and a rotational matrix are added to enable rota- 
tion as well as translation of the on-screen template 
image. For faster scaling, a "Fast Zoom" switch can be 
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added Uiat, when selected, causes the CPU to send a 
control signal along lines 37A and 37B (FIG, 1) that 
varies th setting of the zoom lenses 34 of the 
corresponding cameras 48A and 48B* 
5 If the CPU determines that none of the 

calibration keys have been selected, block 178, It next 
decides If the SELECT key had been pressed, block 186. 
If so, the CPU retrieves a new template Image listing 
from the EPROM, block 172, and sends the Image data 
10 recovered. In bitmapped format, to the DRAM for display. 
For example. If the fifth template listing (defining the 
full Image of the 7-Iron situation) was retrieved during 
the original sequence. In this first repeat sequence the 
sixth template listing Is retrieved (the set-up Image) . 
15 Additional toggling of the SELECT key while in the tem- 
plate Image mode, block 186, causes the CPU to succes- 
sively retrieve the Seventh template listing (the back- 
swing Image) , the eighth template listing (the downswing 
image) and then, once again, the fifth template listing 
20 (the full display image) . 

If the SELECT key has not been pressed, the CPU 
next determines of the MENU key has been pressed, block 
188. If not, the template image already stored in the 
DRAM is redisplayed, block 176. If so, the entire 
25 sequence starts over again beginning with retrieval of 
the menu image listing from the EPROM, block 160. 

The operation of the second group of devices, 
which display the image (menu or template) stored in the 
DRAM 128, is outlined in FIG. 8. Referring also to 
30 FIG, 5, the video address counter 140 sec[uentially 

generates the addresses that correspond to the active 
display area of the DRAM, beginning with location 0, 
blocks 19 OA and 19 OB* As each address is generated, 
first the 9-bit "row" or upper portion of the address is 
35 latched onto the address bus MA, block 192, and th n the 
9-bit "column" or 1 w r portion of the address is latched 
on to the address bus, block 194. Each such latching 
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operation is initiated by the memory cycle switching unit 
156 that sends a control signal to the address multi- 
plexer selecting either the upper or lower input lines of 
the multiplexer. 
5 The MCSU 156 also sends a row or column strobe 

to the DRAM, on control bus MC, to signify that either 
the row or column address has been latched a sufficient 
amount of time to properly stabilize. Shortly after 
receiving the strobe signal, the DRAM outputs the image 

10 data stored in the addressed memory location, block 196. 
The image data retrieved from memory location 0, for 
example, will eventually determine the pixel value in 
the upper leftmost display region of the viewing screen. 
This one-to-one correspondence between memory location 

15 and viewing screen location is a result, as described 
above, of the bitmap^J^ing earlier performed by the CPU 
130. 

The retrieved image data is next converted, by 
the pixel data shifter 142, from a 4 -bit word to a 2 -bit 

20 word, block 198, and is received, in this format, by the 
digital-to-analog converter or DAC 144. If the received 
word is (0,0), the DAC 144 then sends out a default 
signal on the VIDEO SELECT line. This, in turn, causes 
the input of the video switch 136 (FIG. 5) , which 

25 normally connects with the VIDEO OUT line, to temporarily 
connect instead with the "VIDEO (1 or 2) IN" line, so 
that the pixel value obtained is directly determined by 
picture information carried by the live image instead of 
by that processed from the DRAM-stored data, blocks 200 

3 0 and 202. 

If, on the other hand, the received word is 
(0,1) (1,0), or (1,1)/ the DAC 144 transmits an analog 
signal to the NTSC encoder 146 on the red color line, 
green color line, or blue color line, respectively. The 
35 NSTC encoder 14 6, using a standard approach, adds 

together, in weighted proportion, the color signals at 
its input so as to develop the conventional I, Q and Y 
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(luminance) signals. Th encoder then mixes the I and Q 
signals with guadraphase-shifted carriers and recombines 
each of the signals, as shown, to produce a C (chromi- 
nance) signal. The video switch 136 (FIG. 5) , now 
5 obtaining its pixel value from the "VIDEO OUT" line, 
conveys either red picture information, blue picture 
information, or green picture information, depending on 
whether the word encoded was (0,1), (1,0), or (1,1). 
This operational sequence is summarized in blocks 204- 
10 214. This process of developing picture information from 
image data is then sequentially repeated for each active 
memory location and corresponding screen location, block 
190C. In this manner, the various components of the 
static image are colored differently, with green being 
15 used to emphasize the set-up component, red being used to 
emphasize the back^ing component, and blue being used to 
emphasize the downswing component. Of course, with dif- 
ferent weighting values, different colors are obtainable 
so that particular colors can be chosen that are the most 
20 visible in a particular setup. The input of the video 
switch 136 is momentarily toggled to the "VIDEO (1 or 2) 
IN" line, as needed, to provide blanking and syncing 
pulses and to provide an output, 121 or 122, that is 
compatible with existing standards for composite tele- 
25 vision. The output amplifier 159 is used to amplify the 
signal to a level compatible with the sensitivity of the 
visual monitors 18A and 18B. 

Referring to FIG. 1, although a detailed 
description of the internal architecture of the exemplary 
30 video overlay generator 24 has been provided, it will be 
recognized that alternative overlay mechanisms may be 
used. The simplest such mechanism is a transparent sheet 
bearing a static image representing, in outline form, the 
dynamic technique of the master and mountable directly 
35 over the viewing scr n 38A or 38B of th visual monitor. 

The terms and expressions which have been 
employed in the foregoing specification are used therein 
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as terms of description and not of limitation^ and there 
is no intention, in the use of such terms and expres- 
sions, of excluding equivalents of the features shown and 
described or portions thereof, it being recognized that 
5 the scope of the invention is defined and limited only by 
the claims which follow. 



\ 
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WHAT IS CLAIMED IS ; 

1. A sports training device for enabling a 
student to recreate the dynamic technic[ue of a master 
comprising: 

(a) video camera means for transmitting a live 
image of the dynamic technique of the 
student in a selected sports situation; 

(b) visual monitor means for viewing by the 
student ; and 

(c) a video overlay generator for providing a 
static image representing the dynamic 
technique of the master in said selected 
sports situation including overlay means 
for combining said live image and said 
static image for simultaneous superimposed 
display on said visual monitor means, 

2. The device of claim 1 wherein said video 
20 overlay generator includes calibration means for adjust- 
ing the relative sizes of said live image and said static 
image • 

3 . The device of claim 1 wherein said video 
25 overlay generator includes memory means for storing a 

plurality of different static images representing the 
dynamic technique of the master in different sports 
situations. 

30 4. The device of claim 1 wherein said static 

image represents the dynamic technique by an outline 
delineating the path of travel of a respective extremity 
of said master. 



10 
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5. The sports training device of claim 1 
wherein said video overlay generator includes menu means 
for selectively listing on said visual monitor means a 
plurality of different static images for viewing. 

5 

6. The device of claim 5, further including 
selection means operable by the student while remaining 
in position to start the dynamic technique for selecting 
a respective one of said plurality of different static 

10 images. 

7. The device of claim 1, further including 
mirror means disposed within the line of sight of said 
student for enabling the student to indirectly view said 

15 visual monitor means while executing the dynamic 
technique. \ 

8. The device of claim 1 wherein said video 
camera means includes a first and second video camera, at 

20 least one of said first and second video cameras being 
disposed outside the line of sight of said student. 

9. The device of claim 1 wherein said visual 
monitor means includes a first and second viewing screen 

25 together forming a split-screen display means for 
simultaneous viewing by said student. 

10. The device of claim 1 wherein said video 
overlay generator includes blanking means for selectively 

30 hiding different components of said static image. 

11. A sports training method for enabling the 
dynamic technique of the student to be closely patterned 
after that of a master comprising: 

35 (a) providing a video ceunera; 

(b) providing a visual monitor having multiple 
display locations; 
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(c) transmitting a live image of the dynamic 
technique of the student in a selected 
sports situation using the video camera; 

(d) producing a static image representing the 
5 dynamic technique of the master in said 

selected sports situation, including 
providing an outline wherein different 
portions of said outline delineate the 
path of travel of a selected extremity of 
10 said master; and 

(e) concurrently with step (c) , combining said 
live image and said static image for 
simultaneous superimposed display on said 
visual monitor. 

12, The method of claim 11, further including 
the step of maneuvering a corresponding extremity of the 
student so that the live image of said corresponding 
extremity moves along the path of the respective display 

20 locations of said visual monitor that are occupied by 
said different portions of said outline. 

13. The method of claim 11 wherein said 
selected sports situation is a golf swing that includes a 

25 transition between a backswing and a downswing and the 
student has a dominant arm leading the downswing, said 
method further including the step of guiding said 
dominant arm of said student in increasing pronation as 
said transition is approached. 
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AMENDED CLAIMS 

[received by the International Bureau on 23 November 1992 (23.11.92); 
original claims 1,3,4,11 and 12 amended; new claims 14 - 16 added; 
remaining claims unchanged (4 pages)] 

1. A sports training device for enabling a 
student to recreate the dynamic technicjue of a master 
5 comprising: 

(a) video camera means for transmitting a live 
image of the dynamic technique of the 
student in a selected sports situation; 

(b) visual monitor means for viewing by the 
10 student; and 

(c) a video overlay generator for providing a 
static image representing the dynamic 
technique of the master in said selected 
sports situation including overlay means 

15 for electronically combining said live 

image ^ind said static image for 
simultaneous superimposed display on said 
visual monitor means. 

20 2. The device of claim 1 wherein said video 

overlay generator includes calibration means for adjust- 
ing the relative sizes of said live image and said static 
image . 

25 3, The device of claim 1 wherein said video 

overlay generator includes memory means for storing a 
plurality of different static images, each respective 
static image representing the dynamic technique of the 
master in a different sport situation. 



30 



4 . The device of claim 1 wherein said static 
image represents the dynamic technique by an outline 
delineating the curved line of the path of travel of a 
respective extremity of said master. 



35 
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5. The sports training device of claim 1 
wherein said video overlay generator includes menu means 
for selectively listing on said visual monitor means a 
plurality of different static images for viewing. 

5 

6. The device of claim 5, further including 
selection means operable by the student while remaining 
in position to start the dynamic technique for selecting 
a respective one of said plurality of different static 

10 images. 

7. The device of claim 1, further including 
mirror means disposed within the line of sight of said 
student for enabling the student to indirectly view said 

15 visual monitor meahs while executing the dynamic 
technique. 

8. The device of claim 1 wherein said video 
camera means includes a first and second video camera, at 

20 least one of said first and second video cameras being 
disposed outside the line of sight of said student. 

9. The device of claim 1 wherein said visual 
monitor means includes a first and second viewing screen 

25 together forming a split-screen display means for 
simultaneous viewing by said student. 

10. The device of claim 1 wherein said video 
overlay generator includes blanking means for selectively 

30 hiding different components of said static image. 

11. A sports training method for enabling the 
dynamic technique of the student to be closely patterned 
after that of a master comprising: 

35 (a) providing a video camera; 

(b) providing a visual monitor having multiple 
display locations; 
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(c) transmitting a live image of the iynaunic 
technique of the student in a selected 
sports situation using the video camera; 

(d) producing a static image representing the 
5 dynamic technique of the master in said 

selected sports situation, including 
providing an outline wherein different 
portions of said outline delineate the 
path and direction of trav<^ I of a selected 
10 extremity of said master; nd 

(e) concurrently with step (c) , combining said 
live image and said static image for 
simultaneous superimposed display on said 
visual monitor. 

15 \ 

12, The method of claim 11, further including 
the step by said student of maneuvering a corresponding 
extremity while observing said visual monitor so that the 
live image of said corresponding extremity, while being 

2 0 observed by said student to enable contemperaneous self- 

corrective action, moves along the path of the respective 
display locations of said visual monitor that are 
occupied by said different portions of said outline, 

25 13. The method of claim 11 wherein said 

selected sports situation is a golf swing that includes a 
transition between a backswing and a downswing and the 
student has a dominant arm leading the downswing, said 
method further including the step of guiding said 

3 0 dominant arm of said student in increasing pronation as 

said transition is approached. 

14. The device of claim 5 wherein said video 
overlay generator includes means for generating a cursor 
35 image on said visual monitor and means for selecting a 
respective one of said static images for viewing in 
conjunction with movement of said cursor image. 
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15* The method of claim 11 including the step 
of selecting a second static image in substitution for 
said static image originally produced by manipulating the 
controls of an image generator with a portion of sport 
5 equipment . 



16. A sports training device for enabling a 
student to recreate the dynamic technique of a master 
comprising: 

iO (a) video camera means for transmitting a live 

image of the dynamic technique of the 
student in a selected sports situation; 
(b) visual monitor means for viewing by the 
student ; 

15 (c) a video overlay generator for providing a 

static image representing the dynamic 
technique of the master in said selected 
sports situation including overlay means 
for combining said live image and said 

20 static image for simultaneous superimposed 

display on said visual monitor means; and 
(d) mirror means disposed within the line of 
sight of said student for enabling the 
student to indirectly view said visual 

25 monitor means while executing the dynamic 

technique . 



wo 93/00970 



t /8 



PCT/US92/0S274 




.9300970A1 J_> 



wo 93/00970 



2 /8 



PCr/US92/0S274 



— '^N 42G— L- 




1^ 



T-T 





\ ' £ \ 80 

^ 42R, 




30A 



48-^ 



-u' 




42M'7a_^ ^ 

iJ2 84 

421 




78 




28A 



42P--. 

r 1 

! 104 I 

I I 



FIG. 2 



8NS0OCID: <WO 9300970A1 _L> 



wo 93/00970 



/ 8 



PCr/US92/05274 



CO 



X 
UJ 
h- 

O 

cr 

UJ 

> 
q: 



X 
UJ 



cr 
o 



m 

o 
n- 

cr 
cc 

o 
fT- 
m 



to < 

o 
o 

—I 
rr 
m 
a: 



cr 
ui 
u. 

o 
o 



(n 

UJ 
U- 

o 
cr 
a 

u. 
o 

UI 

< 
z 



V 

OQll^U'lUlUtOlO 

oooooooo 
(V)n-(v)n-(un-(V)n- 



oo> 
oom 
oocc 

t-i ex 
m rn 



OCT 
t-it— 

>o 
mi 

So 
I— I 

o 
m 



croo(VJ 
otrcTo 

(VJXIx 

xooo 
iKgoo 



(ucro-cD 
xnjo:— ' 

< 



^UJ 

qOqOqO 
I— • on t— • Ql I— I OH 
(/}U.(/)U.(/)U. 

zzzzzz 
oooooo 
0:0:0:0:0:0: 

»— I »— I »— I >-l I— 1 1— I 





o:Sq:00 
u_(nu.xx 

qq:q:^<^ 

OUIUiXX 

o>>oo 

o:o:»Hi-« 
roooo.Q. 



UjZUlZ> 

(o£otu.5 

(/)(/) CO (/) 

Q.Q.OQI— I— Z 



< 
ujo: 

i-iUJ 

>> 
1-0 

ii 



xx<o 
oococno. 



»-< 
3 -J 

0.00 



cr 



xr 

o 
o 



o 
> 
m 



a: 

o 
a: 



tr 
o 
to 
cr 

u 

UJ 

> 
o 



o 
o 

a. 

3 



a: 



m m 



m 

m 
o 



o 
<\j 

IT 
—I 
< 



en 
< 

CL 

cn 



o o 
»- o 



o 

UJ 

-J 

UJ 

cn 



en en 
to en 




8NSOOCIO: <WO 9300970A1_I_> 



wo 93/00970 



/ 8 



PCT/LS92/05274 



IxJ 
N 



< 

< ^ 

& z u 

Hi o u. 



S ? 

^ < K 



ffi 



^ ^ 

z o Q o 



(n 



a < 
- 1-1 X £r 
< q: ^ Q 

°° \ cr li. 

qTIZ o o 

3 ixl UJ I- 
K _| CD (A) 

UJ _ tr •-J 
> a ^ O 

2 55 2 

o •-• ^ 

£ Q \ 
\ t: o 

I- Q. 2 I- 
O 3 O ^ 

lU ^ -5 2 



a o 

(/) tn "z 

UJ Lu tr 

Q. I- 



in 



cr 

Q. 



UJ 

en 
iij 
cr 

CL 



cr cr 

m m 
(o a) 



»- cr 



m 



cr 
< 



M 
O 
O 



m 

h- cr 

2 ^ ^ 

- S I-. 



m 

3 

I- 
O 



(V) 

ct; o 
<^ 

I- 

^.[: 

CD / 
CO ± 



^: I- ^ s 

s o o o 
< ~» 5 



a: 
m 

h- 
3 
(K 

m 

-I o 

m I- 
o o 

CK P- 
(V) O 

X o: 
o: < 



o 



r\) 



CO 

m 
< 
< 
m 



< K 

-1 o 

cr HH 
O •- 
a) o 

m 
u: 



m 



00 

o 



CO O 

o »- 



BNSDOCID: <WO 9300970A1 I > 



wo 93/00970 



/ 8 



PCT/US92/05274 



CM 

o 

iLl 



r 




wo 93/00970 



S / 8 



PCr/US92/05274 



I 



GET CODE FOR MENU IMAGE 



I 



RENDER MENU IMAGE IN RAM 



160 



162 



FIG. 
6 



DISPLAY MENU IMAGE 



USER 
INPUT 



USER 
INPUT 




164 



68 



UPDATE MENU 
IMAGE IN RAM 



N 



I 



GET CODE FOR TEMPLATE IMAGE 



RENDER TEMPLATE IMAGE IN RAM 



176 



172 
174 



DISPLAY TEMPLATE IMAGE 



USER 
INPUT 



USER 
INPUT 



USER 
INPUT 




180 



GET CODE FOR 
TEMPLATE IMAGE 



I 



APPLY TRANSLATION, 
ROTATION, OR SCALE 
TRANSFORM TO 
CODE VECTORS 



184 



I 



UPDATE TEMPLATE 
IMAGE IN RAM 



I 



/ 8 



WO 93/00970 



PCr/US92/05274 



SET X«0 



190 A 



GET ADDRESS FOR 
MEMORY LOCATION X 



I 



LATCH IN 
ROW ADDRESS 



I 



LATCH IN 
COLUMN ADDRESS 



I 



GET WORD FROM 
MEMORY LOCATION X 



CONVERT 4-BIT WORD 
TO 2-BIT WORD 




W0RD=(1.1) 



190B 



192 



194 



196 



198 



•202 



SELECT LIVE 
VIDEO PIXEL 
FOR DISPLAY 



206 



GENERATE 
RED PIXEL 
FOR DISPLAY 



210 



GENERATE 
BLUE PIXEL 
FOR DISPLAY 



•214 



GENERATE 
GREEN PIXEL 
FOR DISPLAY 



FIG. 8 



190C 



IF X<{512x460) 
THEN X=X+1 
ELSE X=0 



BNSDOCID: <WO 9300970A1 J_> 



INTERNET tOi 



SEARCH REPORT 



P^nutionai application No. 
PCTAJS92/05274 / 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(5) :A63B 69/36 
US CL :434/252 

According to IntemaUonal Patent Classification (IPC) or to both national classification and IPC 



B. nELDS SEARCHED 



Minimum documentation searched (classification system foUowed by classification symbols) 
U.S. : 434/247, 257. 258; 273/35R. 35A, 29R, 29A. 26R. 26A, 183R. 186R. 186C. DIG.28 



Documentation searched other than minimum documentation to the extent that such documents are included m the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US.A. 3.408,750. McCoUough et al., 05 November 1968. See entire document. 



US,A, 4.891,748 Mann. 02 January 1990. See entire document. 



1,3.4,8.9 

11-13 

5-7 

l-4.8,and 11-13 



~1 Further documenu arc listed in the continuation of Box C. Sec patent family aimex. 



Special csteforiei of ckted 

dnnimriitdrfining the geaeml mMtt 
to be put of pwuculw relevaoce 



of the tA which m ooc cooaideml 



later rfommfnf publiihed after its iotentsbooel fUiziff dote or priohty 
date nd not in coaflict with die ■ppltmtioo but cited to uadettuai the 
priDcipie or theoiy lokderiyi&f the i 



earlier docinDent publiihed oa or after the inteniatiooal fUinf date 

d on imr m which may duow doubtt oo pnority claiiD(t) or which is 
cited to estabiiih the pubUeatioa dale of aaother citatioo or other 
special reaaoo im specified) 

do^ient refefriaf to aa oral difclocure. use. cxhibttioa or other 



document publiihed prior to the 
the priority date churned 



iatenabofua fUiiig date but later ihao 



d onimmt of panieukr rekvanoe: the claimed tnveatiop canaoi be 
conaidend novel or cannoi be ooof iderad to iavoive an inventive step 
when the ^fmanrnt im taken alone 

document of pofticular relevmoce; the claimed taventioa cannot be 
considered to invoh^e an inventive ttep when the docttment ii 
combined with one or more other nich documenu. nich combinatioa 
rvioua to a penon •killed in the art 

umember of the nme patent family 



Date of the actual compleU a f th international search 



11 AUGUST 1992 



Date of mailing of th intemati nal search report 



23 SEP 1992 



Name and mailing address of the ISA/ tt^ 
Commitsioner of Pateou and Trademarks 
Box PCT 

Washington, D.C. 20231 
Facaimil No. NOT APPLICABLE 



Authorized officer f[hf/vU^ /if^LLy^e^Z. 

Trvl HARRISON KGOYT/.- KGOe-HO ^ 

mj. HARRISON ^^-^nviLrr-TSTcn 

Tclephon N . r703) 308-0858 



Form PCT/ISA/210 (second sheet)(July 1992)* 



